Building “Stuff”?

Charles F. Vardeman II

Center for Research Computing, University of Notre Dame

2023-09-05

Building Stuff?

Building Agents based on Large Language Models!

Building “Stuff”…

Building “Stuff”…

You are here ⬇️

What Kind of LLM Agents are we trying to build?

  • Conversational Agents
  • vs. Cognitive Autonomous Agents
  • vs. Agents tuned for a Data Processing Task

We will focus on Conversational Agents…

The Best Advice we can Give

Caveat: You are at the Edge of Research and Practice!

Instruction Prompts

Reasoning Prompts

We want Large Language Models to be Factual!

  • “Fine Tuning”
  • Retrieval Augmented Generation (RAG)

We want Large Language Models to be Factual!

  • Fine-Tuning: augment the behavior of the model
  • Retrieval: introduce new knowledge to the model
  • Retreval Aware Training (RAT) Fine-tune the model to use or ignore retrieved content

“Big Models” vs “Small Models”

Open Source Community